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FORIiWORD 

This is the third in a series of reports resulting from a research 
grant to the Coordinated Science Laboratory of the University of Illinois" 
at Urbana-Champaign. The sponsor of the grant is the Illinois State 
Library under ^he Illinois Program for Title I of the Federal Library ^ 
Services and Construction Act. 

Previous reports can be purchased in hardcopy or microfiche from 
ERIC Document ReproducLiuii Service, Computer Microfilm International 
Corp. (CMIC), 2020 14th Street North, Arlington, Virginia 22201. 

1. W. B. Rouse, J. L. Divilbiss, and S. H. Rouse, A Mathematical Model 
>of the Illinois Interlibrary Loan Netwc.k: Project Report No.\l, , 

Coordinated Science Laboratory Report No. T-14, University of Illinois 
at Urbana-Champaign, November 1974, ERIC No. ED 101 667i 

IncL.des a review of. the literature on interlibrary loan networks, 
a flow chart description of the Illinois network, a review of methodo- 
logies appropriate to modeling networks, an initial model, and dis- 
cussion of alternative computer and communication technologies. 

2. W. 1). Rouse, J.. L. Divilbiss, and S. II. Rouse, A Mathematical Model 
oC the Illinois Interlibrary Loan Network: Project Report No. 2, 
Coordinated Science Laboratory Report Wo. T-16, University of 
Illinois at Urbana-Champaign, March 1975, ERIC No. ED 107 287. 

Includes a derivation of the mathematical model (version no. 2) and 
its applications to a hypothetical network so as to illustrate 
various policy issues. A summary of the User' s*Manual for the 
interactive program of the model is also included. 
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• . I. INTRODUCTION AND SUMMARY 

The purpose of this report is to consider alternative request routing 
policies for use in the Illinois Library and Information Network. In pur- 
suit of this goal, we have employed , the mathematical formulation deve^ioped 



^ in our earlier reports,-* Before summarizing the results of our analyses, 

let us briefly review wha't the mathematical model does. 

Given data on interlibrary loan demands th oughout a network; ? 
characterisation of the probabilities of success, processing times, and 
delivery times for the various resource libraries in the net-work; and a 
network request routiiig policy, the mathematical model will predict pro- 
bability ol satisfying a request, a^'erage delay from initiation of the re- 
quest until receipt of the ^lesired item by the requestor, average total ^ 
and unit costs, and average processing loads throughout the network. ThesG 
predictions are broken down by request class and resource library as well 
as being summarized across request classes and libraries. 

Four data files are necessary as input to the model and a substantial 

portion of th^is report .deals with the development of the data for these four 

i * e 

files. Several distinct data sets were available and considerable discussion 

is devoted to considering the consistency of these data sets and to combining 

them where appropriate.. We obtained the necessary data files hut npt without 

the realization that our data is very limited and thus, our conclusions will 

have to be interpreted as tentative and requirx..^, further substantiation or 

perhaps refutation. ^ • ^ 



•'Sec the Foteword Cor a nobe on our earlier reports. 
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With our data £iles obtained, we then consider several approaches to 
policy/formulation, several o£ which lead to similar results. The result 
is basically that ISL and UOI are very much superior to .CPL and SIU- in terms 
of probability of success and average processing, times and, regardless of ^ 
how you tradeoff probability success and average delay, the Centers of 
first'' resort should 'always be ISL and UOI. Further, the superiority of ISL 
and UOI can not be solely attributed to the availability of film catalogs 
for those Centers or to the fact that CPL and SIU must deal more frequently 
with reterred reques.ts. As a public library in a network where public 
librar}^> requests dominate, c'PL appears to have an -availability problem. In 
other words, the local clientele of CPL afe requesting the same items re- 
quested by network clientele, SIU has^this problem to a lesser extent, but . 
also has the weakest collection of the four Centers. Qn the other hand, ISL 
and UOl appear to have loca^l clientele that request different types of items 
than those -requested by the network clientele. 



With these results in mind, we analyzed the impact on netwprk performance 

* r 

of removing CPL and/or SIU from the network. Results indicate that the net- 
work perfoL-mnncc is not signiCieantly degraded by removing both CPL and SIU* 
Perhaps any 'difficulties could be avoided by making either or both of them ^ 
into Special Resource Libraries or Systems (which CPL already ii,). Wiile the 
avaiLal>le data is too lin^it^-d to make a strong recommendation for removing 
CPL and siu from the network, the data is sufficient to warrant a careful^ 
data collection effort to enable a sound decision to be made. 

Our strongest recommendation is that data collection 'procedures be 
iir\7C-h?pTrd-dtatr-Tid"h^w~^ sample sizes to enable firm 
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..conclusions to be drawn from the 'data. Standardized irathods that allow 
comparisons between data cpllection periods are necessary. With the current 
TWX network and various implementations of compu1:er technology now Ijeing 
studied, it may be possible to automate data collection. This would seem to 



be a most attractive possibility. 
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II. INPUT DATA AND, MODEL PARAMETERS 

A. INTRODUCTION ' 

* In this section, we want to first review the input data required 
by the ILLINET model- Then, we will consider the available data sets from 
which we might draw the required input data. Pinally, x^e will discuss the 
specific data analyses performed and the resulting 'irtput data for tha model.. 
Since we have to perform numerous manipulations of the raw data Cb obtain 
the input data for the model, it .is perhaps more appropriate to refer to 
this- input data as the model parameters. Thus,, we will use the terms 
"input data" and "model parameters^* interchangeably. 

B. REVIEW OF DATA REQUIREMENTS 

The input data required by the model can be categorized into four 

« 

classes: demands, probabilities of success, processing times, and delivery 

time. We will now consider each of these classes in detail. 

DEMANDS 

The average number of requests per day (or any other convenient 
unit of time) generated^*' by System k in request class j will be denoted by ^ 

A System is any request-generating organization that can deal 

» 

^ directly with the Centers. Thus, besides the 18 Systems that we normally 
consider, v/e can consider non-System requests (e.g., those from large 
academic libraries) to originate in pseudo-Systems which, as far as the 
model is concerned, op'erate in a manner similar to that of the basic 18 
Systems. ^ , 



'^Requests sent to the Center level of the network 

> 8 
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• * / ' 

Request class can represent subject area,, type of request (c*g., 

dociinient or information), type* of requestor, type of initiating library, 

etc. Of course, a detailed classification of requests will require a. * 

detailed data.^collection effort to obtain estimates of X . As the range 

of j increas.es, the overall sample si^e v/ill have to increase i-f the accuracy 

of each X., estimate is to be mairi^ained. 

PROBABILITO OF SUCCEf5S * , 

.The probability that a request in class j is satisfied by Center 

i will be. denoted by p. Recalling our model of the internal operation of 
^ * . I . ^'^ 

each Center (Project Report No. 2, pp. 32-38), p.. is related to the six 

* 

probabilities tabulated below. Given estimates of these six probabilities 
(which, in general, vary with i and j), one can calculate p. . . 



Probability 


Definition 




probability o£^ a request being received with appropriate 


< 


call number 




nrobability of the desired document being o\^med given 




.that the request is verified • 




probability of the desired document being, available 




given that* it is o\^ed 


V. . 


probability that a request has been verified previous 




Jto Its being received 


• f . . 


probability that an unverified request v/ill be forwarded / 




without an attempt to, verify it / 




probability of the successful verification of a request / 




that was unverified when received , / 



if 
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• We might want to consider, dcfiniiig p^^ as p^.^^ where k varies with 
referral number. This would -allow for thd possibility of referred request^ 
being .intrinsically more difficult to satisfy* In other words, tl\e "easy" 
requests are satisfied when they initially enter the Center l^vel of the 
network wh^le the "hard" requests are referred to other Centers, This 
also requires that the six probaUilitics tabulated above be defined by 
referral number. Thio presents no difficulties for the model, but may 
result in dat^i collection problems. We will discuss this issue at the end. 

of Section II-B. 
PROCESSING TIMES 

The average processing time (time waiting for service plus time in 
service') o£ a request at process^- k of Center i ivfili be denoted ud^^j^. Based 
on queueing theory concepts/ we know that tu^^^ is related to the average 
demand'on process k, and the avcra'ge rate at-which requests, can be serviced 
at process k. . • » 

Tho average^ demand on process k of: center i can be determined 
using \ . , p.., the six probabilities noted above, and the network operating 
policy. 

It i>5 unlikely that the average scrvio^e rate at process k of 

Center i Would be directly measured since this would require detailed - 

observation of the process. Instead, tu^^^ can be estimated via a least- 

squares fit and the average service rate then calculated. The method, of 

estimating u)., will be discussed in SecLion II-D. 
*^ ik 



\hs 3lx processus at a Cuntit arc: ui-proccssing of request, search, obtain, 
out-procc3i;ing of document or information, verify, and out-processing of 
unsatisfied request (Project ReporL Noi,2, p. ^SS). * « • 
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DELIVERY TIMES 

^ The average number o£ days t<J deliver a document or information. 

to System k frcjn Center i will be denoted by t^^^^. Tliis definition could 

possibly be expanded to ^j^jj^ an<j .thus be sensitive to request class This 

would alloy, for example, for different average delivery times for documents 

and information. l-Jliile such an extension of the delivery time definition 

would require only a minor modification of the model, it also has implications^ 

for data collection, in that additional information woul4' then be necessary., 

A COMMENT ON DATA REqUIREMENTS ^ - 

# <* ' • 

Id'cally, one would like to have many request classes to reflect 
.subject areas, types of requests, tyges of , initiating libraries, modes of 
'delivery^ etc. Also, one would like the probability of .success to be 
sensitivce to referral number and average delivery times to be sensitive 
to request class. While, at the moment, the ILLINET model does ,incOrporat;^e 
these latter features, they are minor modifications that^^ll *surqly be 
implemented in the future. 

The difficulty presented by adoption of all of these features is. 
in data collection. An example will serve to cmphasi/ie this point. Consider 

the problem of estimating the probabilities of success" def.ined. earlier. 

^^^^ ' ^ , 

With 4 Centers- and AO request classes-', if we choose to let the. probabilities 

/ . ■ ■ 

be sensitive to referral liumbej and we require data from N requests to make 

each estimate of probability, Uj^j^^* ^^^^n data for at least 6A0 N requests would 

be needed. If wc let N bo 50, which' is hot (i particularly large sample, 

\ 

thcfi data for at least 32,000 requests would be needed. Furtiher, *since 



40 was chosen becz^use two of the data sets which we will employ in later 
analyses incliixic 40 request classes. ^ ' ' 
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every request does not go through .every ^irocess in a Center, a larger sample 

woold be necessary t^ estimate all six pr9babilities associated with Center 

# • * . # 

processing. This increase would have to at least account for the difference 

in processing of satisfied and unsatisfied requests. If \^e assume an 

overall probability of satisfaction of 0^50^ our minimum sample size becomes 

i.A,000 requests. To put this number in context, the two available data 

sets wi^h whi h w.e will be' -estimating probabilities of succesis include 721 

and L044 requests, respectively. Thus, we will have to compromise on 

number of request classes, number of data poinfs per estimate,* etc. r 

I » Ij? 

C. "AVAILABLE DATA SETS * * * 

We ai;e going to employ four sources of data in estimating model 

parameters. These sources include Illinois Stale Library (ISL) yearly 

statistics, t^^ro surveys by the Library J^escarch Center (LRC), and a postal 

dclSjvQxy time study performed -by iSL. At this point, we will simply 

\ . I .'- 

describe thase data sets. In the section following this, we will discuss 

. . ' . . ^ 

estimating model parameters. . ' * 

JLSL YEARLY STATISTICS ' . ' " . 

This data set-'- .sdntmarizcs the activity of the network for the period 

July 1974 through Juno 1975. One portion of this data seL summari7,es 

• * » * 

activity at the System level of the network while another^ portion summa'rizes ^ 
activity at the Center level of the network. 

From the Systems data^ we can determine the difJtribution of public 
n library requests among Systems while the data for Centers gives lis' the 
distribution of all requests among"" Centers as well as the number of requests 



received v;ith call numbers and the number of requests that are 



^\)btaincd from W. DcJohn in October 1975. 



illed^ not filled, xef erred and the -reasons for lack of success in 
* <» 

satisfying a request. This data is aggregated across request classes. 
LRC NETWORK SAMPLE 

For 'this sample, the network libraries were stratified by type: t. 
puMJLc, academic,, special, and correctional. A random sample was drawn 
from each type including 50 public, 20 academic, 20 special, and 7 correc- 
tional while the population included 509 public, 100 academic, 82 special, 
and 21 correctional. The sample was drawn without regard to library size 
ofc igeo'graphical area. , ^ 

All requests initiated by the chosen libraries in February 1975 
were follov/cd as they proceeded through the network. ^586 of these requests 
made it to thct Center level oC the network and, via re^x^rral, resulted in 
the processing ol: 721 requests by the Centers. ^ 

From this sample, we can determine parameters relating to individual 

^x'enters and their success in processing requests in the various reiquest 

classes. The six probabilities associated with Center processing can be 

* * * 

estimated as well .as the processing ^times ;5;ithin each subprocess (i.e., 
^ search, verify, etc.).' Requests are* categon" *-cd into 40 classes and arc 
aggregated across initiating Systems. 

»«* 

LRG CENl'ER SAMPLE ' 

• ' this sample includes 5?^ of all requests processed by each Center 

^ during February 1975., (For ISL, the sample was 7V/o of three weeks of 
/February's requests. . This resulted in 1044 requests. (It should be noted 

that this does oot necessarily represent 1044 unique requests as referral 

/ 

could easily cause a single request to show up in more 'than one Center *s ^ 
sample.) Requests are also aggregated into 40 classes in the sample' 
but thoy are not aggregated across systems. 



We can employ this sample in a manner, similar to the network 
sample. In some cases, parameter estimates can be based on both samples 
while, in other cases, inherent differences in the samples pre ant this 
aggregation. We v;ill pursue this topic further when v;e discuss data 
analysis. l 
ISL POSTAL DELIVERY TIME STUDY 

This data set-^ includes the average postal delivery time (in 
days) between ISL and 13 of the Systems. These averages, as well as the 
sample sixes'by System, can be used to estimate postal delivery times 
throughout the state. 
SOME COMPARISONS 

T\'7o reasons have motivated out'chqice to employ two data sets 
beyond the tv/o LRC samples. The ISL yearly statistics allow corrobora- 
tion for parameter estimates based on the LRC samples. The ISL postal 
study serves as a basis lor estimating postal delivery times throughout 
the state. It might be desirable to have a single sample to employ in 
estimation o£ alj. [larameters. However^ comparing different samples does 
help to corroborc-xte sampling schemes. We will consider this point in 
more detail isx the follovjin^ discussion of 'data analysis. 

D. DATA ANALYSIS^ 

We will now consider how model parameters can be estimated using 
the four data sets discussed above. The parameters will be discussed in 
the categories noted earlier: demands, probabilities of success, service 
times, and delivery times. 

''Obtained from ISL memo by B. Halcli dated December 12*, 1973. 

14 " * 



To process the iwo LRC samplQSj it was necessary to make several 
assumptions. These are detailed in the Appendix, 
DEMANDS 

To estimate X (the average demand generated by System k in 

request class j), we will rely on three' of our four data sets. The ISL 

yearly statistics will be compared with parameter estimates based on the 

/ 

two, LRC samples. The resulting parameter estimates will be based on the 
aata sample that produces estimates most consistent with all three sources 
of information. 

First, v/e will consider the yearly and average daily demands on 

the four Centers. Using the ISL yearly statistics, the results in Tables I 

and II were obtained. To estimate how these requests v;ere distributed among 

Systems, we first must recall that not all requests are generated by the 

basic 18 Systems. Those requests coming from large academic libraries 

(cpllections in excess of 200, OQO volumes) are not processed^by any of the 

basic 18 Systems. To determine how requests are distributed among library 

types, we used the two LRC samples to obtain Tables III. We can see that 

Tables tllA and IIIB differ substantially in Jtheir estimates of the percent 

of requests from large academic libraries (LAC)-<. l^uch estimate should. 

>* • 

we employ? 

Resorting to the ISL yearly statistics for System processing of 
public i.ibrary requests, we found that public library requests resulted in 
7*2,621 titles being sent to requestors. This accounts for 75.57# of all 
titles sent (96,149) by the Centers during 1974-1975. If we use the estimate 

Consider inj; the di£fcrcncus In sampling procedures utilized for the two LRC 
samples, this resivj^t is not unexpected. As long as we are aware of it, this 
' discrepancy does not hinder our analyses. 
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CENTER 


INITIAL 
. REQUESTS 


REl-ERRAL 
REQUESTS 


TOTAL 


FILLED * 


NOT FILtED 


CPL 


31,624 


* 

7,860 


39,484 


5,929 


33,555 


. ISL 


68,750 


2,342 


71,092 


54,959 


16,133 


UOI 


4 J, obi 








27,261 


SIU 


12,954 


15,699 


28,653 


7,994 


,20,659 


TOTAL 


157,189 


37,500 


194,689 


97,081 


97,608 



TABLE I: Yearly Demand on Centers 



CENTER 


REQUESTS 


PERCENT 


PERCENT 




PER DAY^ 


OF TOTAL 


FILLED 


CPL 


157.9 


207. 


15% 


ISL 


284.4 


367. 


777. 


UOI 


221.8 


287. ^' 


51% 


SIU 


114.6 


157. 


28% > ' 


TOTAL 


778.8 


997.^ 


'62%'^ 



a Assuming 250 days of operation per year. 

b Sppcial, Resource Libraries process 17. pf*^the overall demand, 
c Based on unique requests. Otherwise, entry is 507.. 

TABLE II: Average Daily Demand on Centers 
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from Table IIIA, we find chat 55.27, of the requests (7.PUB) obtain 75.5% 

> *• 

of all titles sent. This *can only be true if AA.87. of the requests 

(7*non"PUB) experience very low probabilities of success- A later analysis 

will show that this is unlikely. Thus, we must conclude that the estimate 

& 

from Table IlIB should be .employed in further analyses. 

Us,ing tha LRC Center sample, we detarmined distribution of requests 

among Systems shown in t^he left columns of Table IV. The LA percentage^ 

increased slightly over that in Table illB because some non-LA requests 

were without System codes.' 

.The "titles received" entries^of the ISL yearly statistics for 

Systems uere also used to estimate the distribution of re.juests among 

Systems. Three assumptions are required to use .the ISL yearly statistics 

for' this purpose. First, we assume that the percent of tota\ public 

library requests generated by 'a specific System is indicative of the per- 

cent of all requests generated by tliat System. S.econd, we assume that 

probability of satisfaction at the Center level of the network is independent 

of the specific System generating the request. Third, we assume, that the 

ratio of titles sent to requests filled (by the Center level of the network) 

is independent of the specific System generating the request. Using these 

assumptions, the distribution of requests^ among Systems was determined aod 

is sliown in the right columns of Table IV. . , ' 

The tv;o sets .of estimates are similar in magnitudes but have 

*> 

definite differences. This poses a dilenuna. The LRC data includes a 
one-month's sample while the ISL data is a year's data. On the other 



^ ^^A 19th System was defined as^including all large academic libraries. We 
could define each largo academic library as a Syf?tcm and thus, he more 
accurate in our operational description.^ However, the small, number of 
requests generated by large academic libraries does not appear to justify 
such detail. 
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LRC Center Sample 


ISL Yearly Statistics 


SYSTEM 


PERCENT 


SYSTEM 


PERCENT 


BO > 


5 •73 


BO 


4.76 


CP 


1 Oft 

1.38 


CP 


0. 18 


e 

CB 


6.15 


CB 


3.97 


CT 


3.08 


CT 


2.50 


DU 


5.83 


DU 


6.A6 


GR 


1 Oft 

1.38 


GR 


2.33 


IV 


5.62 


IV 


3.05 _ 


KK 


A. 03 


•KK 


6.09 


LA* 


7.10 


LA'*- 


6.57 


LC 


2.55 


LC 


4.88 


LT 


A.IA 


LT 


4.26 


NS 


16.12 


NS 


13.20 


NI 


3.82 


NI 


6.10 ^ 


RB 

t - 


1.05 


RB 


, 1.42 . 


RP 


4.98 


RP 


5.20 


sii - 


3.82 


SII 


6.20^ 


SR 


3.29 


SR 


4.^96* 


SU 


16.. 44 


SU „ 


13.88 


WI 


3.50 


WI ^ 


3\98 



Large Academic Libraries 
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hand, we required several assumptions Lo pull the desired estimates out of the 
ISL data. To resolve this issue, we will continue, as we have throughout this 
report, to utilize estimates based on LRC data and include estimates based on 
JtSL data Cor comparison purposes only. 

The two LRC samples were used to estimate the distribution of requests 
among subject areas. (The 40 subject'^c lasses are those chosen by LRC.) The 
results are shown in Tables* V. If we as.sume that the subject class, of a 
•^particular request is independent of the type of library initiating that 
request, then Tables VA and VB can be merged. lIowey§r, ev(^n when the tables 
arc merged, some classes have very few requests. Since we plan to further 
subdivide the subject distribution by Center and perhaps by referral number, 
we will have to decrease the number of subject classes to maintain the accuracy 
^oC our estimate of the distribution of requests among suljject classes. 

We decided to reclassify the requests into the 10 Dewey classification 
ranges (i.e., 000-099, 100-199, etc.). Since the LRC network sample includccl 
call numbers with many requests, this reclas.sif iqation would appear easy. 
Unfprtxmately however, no Eixed procedure vas used by LRC in determining one 
of the 40 request classes from a rpquest'^ call number. In an attempt to 
. aUcviatc this difficulty, thejietwork sample was sorted by request class and , 
the call numbers within each class printed oiit. Inspection of the results led 
to the reclassification summarized in Table VI. Using this scheme yielded the 
results in Table VII. '375\oC the 422 requests with legitimate call numbers 
were reclassified correctly. A reclassification scheme that will surpass this 
89% accuracy is not evident. 

Using the schema discussed -above. Tables V, become Tables VIII. The 
two samples are combined in Table IX. Ranges 0, 1, 2, 4, and 5 have fairly 
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21 
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21 


b 


72,41 


2 . 


«3 
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22 
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4,30 


17 


13 


56,67 


3 
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5,7 3 


2b 


14 


bS,M0 
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5 


0,72 
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a 


39 


5,59 


33 


. b 


Oa,b2 


24 


25 


3,58 


• 4 
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1« 
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6 
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25 


20 
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14 
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6- 


iw 


l,a3 


h 


5 
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26 


. 2 


0,29 


2 


0 
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7 


lb 


2,56 


17 


1 


94,44 


27 


15 


2,15 


10 


b 


66,67 


b 


21 


3,01 


15 


b 


71,43 


28 


8 


i , 15 


b 




62, b0 


9 


b 


es,bb. 
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29 


1 


0,14 


I 
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.10 


lib 


b,«5 


33 


12 


73,33 


3(i) 


17 


2,44 


9 


8 ' 


52,9a 


11 


13 


1. 8b 


11 


2 


84, b2 


31 


3H 
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22 


ti 
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12 


2 
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4 


1 
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2 
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62^05 




13 


1.8b 


12 


I 


92,31 


3« 


69 


9,a9 


48 


21 


69,57. 
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3 
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9 


1 ,29 
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• fl 
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(Note: 23 requests had no subject code,) 

TABLE V A: Distribution of Requests Among Subject Classes (Network Sample) 
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1 


24 
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21 


52 
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23 
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35 
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22 
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40.00 
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■ 33,33% 
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13 
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29 


13 
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4K 
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17 
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30 


19 
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8 


11 
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12 
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. .9 


3 
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25 


14 
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0,.8'1 


6 


2 


75,00 


38 


18 


1,88 


• 10" 


8 


55,56 
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15 
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0 


0,00 
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had no 
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O TABLE/y B: Distribution of Requests Among Subject Classes (Center Sample^ 
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C ALL NO. IIANGE LRC SUBJECT CATEGORIES'^ 

1 
2 
3 

4-11 
12 

.13 - 16, 19 
17, 18, 20 - 24 
25 - 30 

31, 32, 34, 35, FIG, JFIC 
33, 36 - 38, BIOG 

There were no requests in categories 39 and 40. 

TABLE VI: Scheme for Reclassifying Request Subject Areas 



Range 


NO, CORRECT 


NO, INCORRECT 


NO CLASS, 


ERROKS 


Q 


15 


0 


a 


1 . 


1 


27 


5 


6 




a 


16 


7 


7 


n 


3 


67 


6 ■ 
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<l. 


■ 1 


fl 


■ 0' 


■ : ' 


5 


25 


7 


M 


■ 0 


6 


60 


9 


315 




7 


35 


a 


9 




8 . 


813 


♦ 

1 


8 




9 


a9 


8 


12 


0 


TOTAL 


375 


m 


153 




NO SUBJ, 


CODE « 9 , 









.TABLE Vll: Rar..ult:s o£ Reclassifying Request Subject: Areas 
(Natwork Sample) * ^ 

••* 

"> • 



i 



ERIC 



000-099 
100-199 
200r299 
300-399 
400-499 
500-599 
600-699 
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X 
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IINFILU 
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1 fa, 






7V^(()7 
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S.7i 
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3 


1 66 


2^.78 


Irift 


38 


77.11 


a 


? 


«.?9 


? 


0 
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3ft 


9 






1?5 


17, 9i 


71 






7 


b3 


•J, 03 








S 




1 5 , /( / 


76 




7«.37 


'9 


8/1 


,. . ' 






76, 1 <^ 
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SUfiJ . 


CUDEs 
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TABLE VIII A: 



Distribution, of Requests Among iJewey Subject classes 
(Ne^^work Sample) - * 



rhNTEH SAMPLE 
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no. 


«L0. 
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0 
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ID 
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? 


m 
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5 


H.S2 


? • 
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5 
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5.22 


3ft 


1« 


72:, (';(^ 


h 
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Ti 


1PI3 


« 1 '.8 1 
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l.-^.15 


ftR 


. ftb 


'a, 6 3 


R 




12,53 


7PI 


5» 


58.33 


9 


12Q 


13,'<7 


,70 


59 


5/4 ".2 6 


T'UTAL 


<5'i8 






a /1 9 


53,13 


NO. WITHOUT sun J. 


c'onE = 
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TABLli VrH 8: Distribution of Requests Among Dewey Subject Classes 
(•Center Sample) 



RANGE 

0- 

1 

?. 

5 

6 

7' 

8 

9 

TOTAL 



- N(j, 
Rf-'U, 

,au fl 

113 

M7 

37b 
7 

9b 
30? 
1 89 
2?H 
? 13 
IbSf) 



2,/fi 
b,8? 
3.25 

?? , ^ 1 

18, 

J 1 , '4 1 
13,77 

12,86 



NO, 

FILO 

30 

b9 

5P 
25? 

7? 
l')5 
IPl 
1«6 
17'4 



NO, WITHOUT SUfUl, C,OnE = 



MO, 

UNKlln 
16 
IX IX 
f 37 
12" 
3 
27 
157 
, 88 
8? 
70. 

653 
1H9 



'L 

KILO 
65, V2 
61 ,tl6 
'^1,1X7 
67,W'2 
57., m 
75,79 
i»8,C51 

53,'ia 

6 '4 , CI a 
ft?, 91 
.60»57 



TABLE IX: Distribution of Request;! Among Dewey Subject Classes 
(Combined 'Samples) 

23 V 
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4 

small sample sizes which miyhc niake grouping of classas desirable. However, a 
* 

classification schtime based on the 10 Dewey ranges is attractive from the point 

* * ^ " ' ' * 

of view of implementing results in the sense of the request routing policies to 

be recommended later- in this report. Tluis , we will retain the 10 ranges. 

The center sample was employed to estimate .th^e average daily demand 

^einanating, f rom each System in each subject class. Since the sample includes 5% 

of twenty da)s* activity, it can be directly interpreted as the average daily { 

demand'. The results are shown in Ta&le XA. 

* * For comparison purposes, vre also used the ISL yearly statistics to 

estimate the average daily demand. Recall from Tal^le--II that Centers process 
requests at an average ^rate of 778.8 per day. Combining this figure with the 
results in the right column of Table IV and those in Table IX*, yields the dis- 
tribution of requests shown in Table XB. the results are comparable with both 
approaches. As before we will employ the estimates^ based, on the LRC data in all 
^. further analyses. ^ *^v. 

The estimates irt Table XA provide the X,, parameters discussed earlier. 

■t ^- . ' ' ■ ■ 

This table is al^iost identical in format to the demand .data file accessed by the 

model from disk. * ' ' >^ 

• - o , ^ • ' / 

, PROIi*\BILITIES OF SUCCESS . ' ' , 

A .A 

Recall that the probability that a request in class j is satisfied 
by Center i (denoted p^^) can be derived f*.yn the six constituent .{5robabilities 
c^., o.., a.., V.,, f.., and s... For the moment, we will aggregate across 
request classes and thereby simplify the discussion. 



It is assumed that the subject distribution is independent of Systems. 
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K'ANnt: (SUH.ltCl CLaSS.IKICATIU'I) 
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TABLE XA: Distribution o£ Averiagc Daily T)cmand 7?GquGsts/pay), 
Amo.ng Systems and Subject Classes (Center Sample) 
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UABLE XB: bi.str ibuLion of-Aver.agc Dc^ily Demand (Requests/Day) Among Systems 
4 ai\d Subject Cl^asscs (ISL Yearly Statistics), 
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Tables XI show how the probability of success varies with Center 

and' re'^rral number, llie most striking difference between Table XiA and XI B 

< 

IS found in overall^ probability of success Estimates (i.n the lower right- 
hand corner of each table). '^Ihe network .sample yields an estimate of 68.67<» 
while the center sample yields an estimate of A9.5%. ISL's yearly statistics 
show 50.0% for this overall probability. Once a^ain, x^e find ourselves 
supporting the use of the center sample (Table XIB) as opposed to the network 
sample. To explain why the network sample overestimates probability of success, 
rec.ll that non-public libraries are overrepresented in the network sample. If 
requests from non-public libraries experience morc^ success than those from 
public libraries, the differei.ce in overall probabilities of success might 
easily be explained. This conclusion also supports our earlier decision to 
use the center sample as a basis for estimating the distribution of re'quests 
among library types. 

We also see in Tables XI How probability of success vaties with 
referral number. Probability of success definitely decreases when proceeding 
Irom't^he zerpeth to^Lhe first referral. Apparently, referred requests are 
more difficult to satisfy. Unfortunately, there is insufficient data to 

'cpnCidently conclude that th& second and third referrals result in success- 

« • * 

ively .lower probabilities of success. This lack bf data will be very evident 

» • *^ 

\nce we break these proliaBiliLies down by request class. As noted earlier, 

I* • 

the model could easily be adapted to u Llize probabilities that are dependent 

0 

'on referral number. However, this will require either more data or fewer 
request classes. *\ ^ 



'^The chcLcc of Ihc number oT subject and referral' class^is into which your data 
i5 parLiLioned dcpendi^ on hui^ you xcanL to emphasize *\subjecL sensitivity" and 
••referral sensitivity" in the network operating policies. 



' 27 



NtTwoRA SAMPUE 





isu 


UUl 


SIU 


TUT ■ 








1 1 


5P5 


v ^ t * ' 




75.97 


I'j.av 


61, 




27 k) 


153 


J) 


. asa 


55 


2b 


aa 




131 


as. 5a 


91,22 


75, iq 


as, as 


77,61 


9 




aa 


3a 


67 


' • * 




Id. 88 


17,89 


12, «7 




V) 


23 




37 


9 




21 


2 /J 


.50 






5^2.27 


=ai,i6 


a2,53 






12 


23 - 


as 






5.15 


32,39 


6,24 






3 


M 


.3 


1 T' 


y 


9 


23 


a 2 






,,2S.,HM 




b,67 


0 


1 


0 


3 


'a 




v),3a 




a. 23 


0,55 


t) 






I 


I 


W 


I 




2 


3 




0,(00 




33,33 


25, WIS 




297 


333 


71 


721 




«1.19 


32,32 


",<JS 


100,00 




27 M 


159 ' 


2M 


a95 


7 a 


27 


^7 a 


51 


22fa 


36, i A 


90,91 


6{J,2« 


28, W 


bB,b5 



ProbabiliLy ot Success as a Function of Cenuer and Referral Number 
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To' overcome the .scarcity of data, we decided to pool the tx-jo LRC 
samples within the 10 subject jclasses"" and not consiuer variations o£ 
probabilities with referral^,number . fhe pooling o£ these two data sets within 
.subject classes requires that we assume that probability o£ success, within a 
given subject area, is not related to the type o£ library from which the request 

* 4 

originated, 0£ the 1765 requests in both samples, 109 were without subject 
codes. . Thus, our overall sample is 1656 which is divided among 4 Centers and 10 
subject classes. Table XII shows the frequencies oC success at each Center. 
For each category (i.e., call no., prev. ver. , etc.)> the^left column represents 
the number of ruquubtb with that chdrdcturistic while the right column represents 
the number o£ requests .without that characteristic. For example, for range 
0 (000-099) at CPL, 8 requests were received all o£ which were without call' ^ 

r • 

numbers. 7 o£ the 8 had been previously verified. A were owned while 4 were 
not owndd^. Of the A owned, 1 wa? available while 3 were unavailable. The 
previously unveri^lLcvi ruqucst was nut forwatrded without an attempt'at verifica- 
tion. Howevtir, it was not successfully verbified. 

Table XIII represents the same information but has been converted 
to prohrihilities . This table is very similar to the probabilities of success 
data file accessed by the mode]. To compare these parameters* with ISL yearly^ 

statiSwics, we calculated probability ol receipt with a call number, probability 

i 

of ownership aiid probability of availability given ownership using ISL aggregate 

(across subject classes) statistics. This resulted in c^^, estimates or 0,01, 

OJl, 0.11, an* 0.03; o. . estimates, of 0.35, 0-9l, 0.63, and 0.41; and a.,. 
. i^ * 

estimates were b,4A, 0-86, 0.82, and 0.69 for GPL, ISI^ UOI, and SIU, respec- 
tively. ,With tfie exception perhaps of the CPL o. estimate, the comparison is 
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favorable. This partially justifies our. necessary pooling the two LRC samples 
and may indicate that the reason for greater success in filling non-public 
library requests (noted earlier)^ is due to the subject distribution of those 
requests. In other words, within a subject area, probability of success is not 
related to originating library type. Thus, non-public libraries experience 
gre '».er buccei>i> because their requests are in subject areas Lojr which documents 
are more likely to be owned and available^. This last point is only conjecture. 



PROCESSING TBffiS 

Now, we want to estimate the average processing time of a request at 
process k of Center i (denoted by x.,). To approach this problem, wo will first 
consider the overall processing times for satisfied and unsatisfied requests. 
These arc shown in Table XIV, Note that unsatisfied requests at ISL and SIU 
require much mure processing time than satisfied requests. On the other hand, 
.unsatisfied requests at UOI require less processing time than satisfied 

at, 

* requests, Ilow can we explain this result? 

V- 
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Recall our discussion of CenLcr level processing in Project Report 
Nos. 1 and 2 (No.. 1, pp. 20-27, No, 2 pp. 32-37). .There we note that average 
overall processing Lime can be represented as a weighted linear sum of the 
average processing times in each of the six processes of a Center 

(u).i, U).^, a).>:). The weighting on u)., is 0 if the request did not 

tl ' th * 

utilize the k process, 1 if the request utilized the k process once, 

2 if the request utilized the k^^Vprocess twice, etc. We know the overall 

processing Lime and the v;eightings from information collected in the LRC 

samples.- We want to estimate a*j^j^,*u)^2' 

* 

From the two LRC samples, ^^?e can fom 1062 linear equations in six 
unknowns per Center. Using an optimization technique to find the ^^j^'s 
that minimise the muan-squated error between the predicted overall processing 
times and the actual overall processing times we obtained the results in 
Table XV, The technique was constrained from producing any uj^^^ less than 
0.10 day* These results seem reasonable as the rooL-mean-squared (MS), 
fitting errors arc conunensu.rate with the standard deviations in Table XIV. 
It should be stressed that these results are only valid as far as our data 
processing assumptions (in tlie Appendix) and the model of Center level 
processing (Report Mos. 1 and 2) are valid. 

Considering some of the specific entries in Tablo XV, we see that 
ISL ai. SIU have large estimates for average Lime to forward an unsatisfied 
request. This is consistent with the resultc for overall processing times 



"See the Appendix for assumptions necessary in processing this data. 

'Of the 1765 requests represented in the two LRC samples, only 1062 had 
sufficient information (i.e., date entering and date leaving a Center) to 
be used in this analysis of processing times. 





TN-PROr 


SFAHCH 


OBTAIN 


OUl'-PROC 


VERIFY 


FORWARD 


N 


. RMS 


CPL 


4;42 


0.10 


0 


.10 


0..46 


.0.92 


0.68 


135 


4'. 22 


I I?L 


3.05 


1.80 


0 


.10 


0.13 


4.84 


6.26 


489 


4.66 


UOI 


2.32 


1.45 


0 


.10 


3.14 


o:io 


1.34 


344 


5.20 


• SIU 


2.34 


3,22 


0 


.10 


0.94 


3.14 


6.85. 


94 


4-. 06 























TABLE XV:- Average Prucessing Times (in Days) for Each of the Six Processes 
* at Each Center , * 



noted above. The optimization .technique estimates a large Value for for- 

warding time because that is the only one of the six processes which. 

unsatisfied requests exclusively employ; 

On the other han&, UOI has a' large esi:imate for time to out-process 

a- document; The optimization tpchuique estimates a large time for out-processing 

to account for increased overall processing time for satisfied requests. Intui- 

tivcly, knowing the UOI campus and the geographical dispersion of its departmental 

libraries, one might expect that the obtain process would ba the cause of increased 

processing time for satisfied requests. To pursue this possibility, we performed 

a more detailed analysis. of within Center processing. 

We started with three hypotheses. 

♦ ^ * 

1. Requests entering with call numbers and thus avoiding the^ search 
y process, should have significantly less overall processing times 

^ • than requests that must be searched. 

2. Requests entering with previous verification and thus avoiding 

the verify process, should have significantly less overall ^ 
processing times than requests that must be verified. * 



"The entries ix\ this table should not be interpreted without reading pages 
in the text. 
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3. Requests for unowned documents which .thereby avoid the obtain 
process, \liou Id have significantly less overall processing 

« 

times than requests for unavailable documents that must go 

r 

thr6ugh the obtain process* 
Testing the above three hypotheses- for each Center, we find hypothesis 1 
supported for ISL and UOI while no other hypotheses were supported for any 
Center. In other words, the available data did not support the hypotheses 
that verification and obtaining are significant components of overall proccjss- 
ing time. This docs not mean that these processes do not in fact consume 
significant amounts of time, but only that the data was insufficient to prove it 

More specifically thCi verification hypothesis- is subject to much 
statistical error due to the great ambiguity of res{.onscs on the questionnaire 
forms (sec Appendix). The obtain hypothesis was tested using very small samples 
This was due tp^ the fact the date information was not filled in for many^unsatis 
ficd requests and wu can only look at the iii>i>act of tlie obtain procession 
unsatisfied requests. (All satisfied requests go through the obtain process. ) 

Thus, the average processing times for obtain ^and ver;.fy are not of 
much ubc and sliouki be interpreted accordingly. For example, we cannot use this 
data to predict the impact of co^iputerizcd circulation systems on network per- 
formance because one of the maii\ benefits of such a system is the avoidance 
of the obtain process unless the document is available and we have little or 
no faith in the estimates in Table XV that indicate how much processing, time 
might be saved. 



J'Morc fprmaliy, wo used a t-tcst to test the hypothesis that significant 
differences did not exist. Hypotheses were rejected when> the significance 
level was ^ ,05. 
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Another point is also important. ' Since all satisfied requests are V 

* 

processed at in-process and at out-process, \/e cannot separate the average 
amount of time devoted to each process • Similarly, since all unsatisfied 
requests are processed at in-process and at forv;ard, v;e cannot separate the 
average Lime duvuted to each of these processes. When using the non-queueing 
option of^ the ILLLNEI model, this difficulty has absolutely no effect gn model 
, predictions. However, with the queueing option, it does add an unknown for 
which v;e have no information. Thus, v;e will not utilize the queijeing option 

in 'latej: analyses ,Lo be discussed in this report. In the future, different 

■» ♦ 

data collection procedures may avoid this problerft* 

^ As a final qomiiient on the estimates of processing fime discussed 

here, we should note that weekend days are included in the processing time 

estimates. Thus, the xjesults ^o not necessarily represent continued active 

( ' ' * " * 

processing of a request and may include periods when the interlibrary loan 

. . , i ^ • . . .... 

effort is closed down. V/e could adjust the LRC data to exclude weekends, 

/ 

but it seems more appropriate to retain the time estimates that the 



requestor actually endures. 
DELIVERY TIMES 

;ro estimate t., (the avoraRe postal delivery time to System k. 
from Center i), we will use data from the previously noted ISL postal 
^t-^delivery time study.., _ Wiile this data only includes average du., very times 
from ISL to various Systems, we will assume that this data is typical of 
postaf service thiroughout Illinois, 
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One would' imagine that postal delivery times are related in some 
way to 'dis tance . To estimate the distances between C^enters at^d Systems, 
we assume Systems Xo be in the geographical center o£ the region they 



represent and then measured the straight-line distances between points.^- 

Plotting the ISL delivery time data versus dis\:ancc , v/e reached t\;o 

conclusions. First, .average delivery time is roughly a linear /unction 

o£ distance (i.e., t., = a + bcl., where d., is the distance between 

Center' i and System k while a and b are constants) Second , the linear , . ^ 

function is dili^crcnt it'a metropolitan area (Chicago' or St. Louis) is 

involved. 

Based on these conclusions, we employed a weighted- leas t-sqifared- 

crrpr fitting method (weighted by the number of Jata points ia each estimate 

of average delivery time) to obtain the following results. For deliveries^ 

* \ 

s 

involving mctropoli tan areas, we found 0.85 + 1.13 d^j^ (where, the - 

units of d., ape hundreds of miles) with a ,root-mcan-sc|uaied fitting error 
lie > ♦ y 

p'f 0.200 days. Similarly*, for deliveries involving .only non-metropolitan 
areas we found t., = 0.97 + 0.29 d., with a i*oot-mean-squared fitting error 



:tions to estimate average deli\ 



oE 0.157 days. 

Using these two linear functions to estimate averagji delivery time,s 

^ i 
between all Centers and Systems, the results in Table XVI were 

obtained. To estimate the average delivery time for large academic libraries 



While Systems are not necessarily in the geographical centers cf their 
regions, a more exact knowledge of their location is not necessary in 
light of the less tenable assumption that straight-line distances arc 
appropriate. However, we have no practical alternative but to use this 
straight.- line assumption and, since we are only estimating avcra?;e 
delivery times, the accuracy of our estimates is probably not 
substantially cLffected by this approximation. 
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(our 19th SysLcm), we used a wei^jhted average of the average delivery times 

* " * ' th <* ' 

Cor all other Systems where the weighting, on the k System^s average , delivery 

* * * 

time was the percent of overall demand generated by that System, 

f 

SUMMARY • * 

Tables XA, XlII, XV, AND XVI include the desired model parameters. 
U'e will now proceed to discuss using the ILLINET model and the^implicatiohs 
of ^various netv;ork operating policies. However, before continuing, a word 
.of caution i*s appropriate. The model parameters which .wa have obtained 
represent the state of the neu%rk in 1974-1975 as best we could determine ' 
it with available data. Parameters will certainly ^vary in the future as 
demand level,*^ change and new technology is implemented. Thus, the parameter's 
tabulated in this report shoMld not be maintained as necessarily the "true" 
par:ameters. Data collection will have to continue and pdraneLer values 
updated. This section of our report indicates what .data of interest. 
We hope in the future to be able to describe a rigorous and systematic ^ 
method of data collactiua that will enable monitoring of xhc model and 
updating bC parameters. y ^ 
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III. POLICY ANALYSES 
A. IOTROi)UCTION 

The, purpose of this section is to illustrate the effects (on network 

perfornionce) of several classes of request routing policies. We will first 

consider a class of policies that emphasize ipaximizationy of probability of 

success without regard Lo average delay from .initiation of^a request until 

receipt of the desired item by the requesting SysteiQ. Next, a class of 

♦ • 

c. 

.policies that emphasize minimization of average delay will be discussed^ 

Then, we will consider la class of policies thai: tradeoff probability of 

success and average c^lay. The meaning and possibility of optimal request 

roul;ing policies arc then discussed and finally, some specific recommenda- 

- / 

Lions are summarized and evaluated. 

As we have pursued these analyses, it has become increasingly evident.. 

♦ 

th^t our sample sizes are inadequate for the type of analyses that we are 

developing. For example, several of the percentajxcs in Table XIIJ. are based 

v»n data from two requests. Nevertheless, management decisions still must 

be made and one has no choice Jbut to employ whatever data is available. 

However, the reader should keep /n mind that results discussed in this sec- 

tion should oe viewed mainly as interesting possibilities which require 

<• 

further data for complete justification. 

B.. POLICIES TlLVr KMPllASIZE MXXIMIZATION OF PROBAlilLITY OF SUCCESS 

An intui4:ively appcaliW routing policy is to simply send requests to ^ 
the libraries most likcly*>^^sati,sfy them. This approach may be unsatisfac- 
tory if, for example, the library most liketly to satisfy your request is ^ 
distant in delivery time (e.g.j Now York Public Library) while a local library 
(e.g.. Champaign Public Library) may have a slightly -lower probability of 
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succcs buL can saLii»£y your request in 30 minutes if the item is owned and 
available.} Dibregar/ing this limitation, we will now consider the network 
performance res;il,ting with policies that emphasize probability of success. 
' The .policy is simple. Within each subject class^ order the four Centers 

(CPL, ISL, UOI, and SIU) by decreasing . and refer requests in that order 
until satisfied ur a constraint is met (such as a budget limitationj which v;e 
did noXl consideO • Fur this class of policies, all Systems would utilize the 
same policy within any given subject class. Using these policies, the ILLINET 
Model produced the results slvown in Table XVII. 

As policies allow more referrals, we see that probability of success 
increases as does average delay and cost. An interestjjj^ numeric is the 
marginal unit cost of referral which can be defined a^ • * 

increased total cost due to referral 
V marginal unit cost - ^^^^^353^ o£ satisfied requests du^ to referral 

Using Lhio dcfiniliun of marginal unit cost, wc find that the £ivrA referral 
yields a cost of $3.25 per satisfied request, the second referral yields a 
cost of per satii»fied request, and the third reieiral results in a cost 

o£ $3.78 per satisfied requefit. Thus, ve see that unit cost only increases 
modestly with number of rei^errals while marginal unit cost 'increases vary 
Sjiibstantially. This is jsimpiy due to the fact that the referral Centers 
(usually Cl'L and SIU) do not perforoi as well (in terms of probability of 
success) as the initial Centers (usually ISL and UOI).. 
C. I>0LICIHS Tlli\T f-MlMbXSIZK MINIMIZATION OF AVini/\GE DHLAY 

Instead of. maximizing probability of success, we might choose a routing 
policy that yields the minimum average delay. Then, the requestor will re- 
ceive the desired item relatively quickly if liis request is satisfied. Of 



ERIC 



^ 42 



PliRI-ORM/XNCIi 
Yll-ASURIi: 




NUmER OF 


liEFE RIVALS 




0 


1 


2 


3 


INPUT DKbUND PUR DAY'V 


860 


860 


860 


860 


TOTAX DEM/\ND^PER DAY 


860 


1014 


1072 


1110 


NO. SATISFIED PER DAY 


706 


801 


820 


829 


, NO, UNSATISFIED PER DAY 


154 


212 


252 


2S2 


PERCENT SATISFIED 


82.1 


93.2 


95.4 


96.4 


AVERAGE DEIAY (IN DAYS) 


5.92 


7.58 


7.98 


8.27 


TfffAL COST' PEIl DAY 


\ 1071 


1380 


1465 


1517 


COST PER SATISFIED RliQUEST 


1.52 


1.72 


1.79 


1.83 



^•'250 days of oporaLion par year is assumed. 

TAliLK XVII: Network Performance 'With Policies That 
Emphasize Maximisation of Probability 
of Success 
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course, the dillicully with this policy is that the library which performs' 

velTin terms of average delay may nut perform well in terms of probability 

of success. This problem can be partially avoided by defining average delay 

for a library as - f. 

average delay - probability of success x average delay for satisfied requests + 
probability of failure x average delay for unsatisfied requests 

where probability of success is the . defined in section II-B, probability 

of failure is I'^j^j^ and the average delays for satisfied and unsatisfied 

requests are found in Tabl6 XIV. 

To define a route, proceed as follows. Within each subject class, order 
the four Centers by increasing average delay as defined in (2), and refer re- 
quests in tliat order until satisfied or a constraint is met. For this class 
of policie/^, all Systems will not employ the same policy within a given sub- 
ject-class, ^Instead, for a given System and subject class, we calculate the 
average delay experienced by the System (utilizing the appropriate delivery 
times from Table KM) for each alternative route' and choose the route with 
minimal average dela>.'- Thus, each System has a .choice of four possible routes 
for each subject classes. (Cach of the four alternatives represents initiation 
at one of the four Centers and refetrals chosen by equation (2)). 

Using this approach to policy formulation, the results in Table XVIII 
wore obtained. Comparing Tables XVII and XVIII, we sec that those policies 
in Table XVII arc clearly preferable except when there is one referral. With 
one referral, the policy in Table XVIII results in less average delay, approx- 
imately the same unit cost, and lower probability of success than obtained 
with the policy in Table XVII. The particular policy preferred for one referral 



''aMs tomputaldon is performed utilix-ing equations 1 through 5 in the 
Appendix of Project Report No. 2, pp. 27-30. 
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I'ERI-ORM/\NCE 




NU^ffiER OF 


REFERRALS 




MKASURE 


0 


1 


2 


3 


INPUT DEMiVNT) PER DAY-- 


860 


860 


860 


860 


TOTAL DEM/\NI) PER l>x\Y 


860 


, 1014 


1126 


1170 


NO. SATISl-IED PER DAY 


291 


749 


816 


829 


NO. UNSATISFIED PER DAY 


569 


266 


310 


340. 


PERCENT SATISFIED 


33.9 


87.1 


• 94.9 


96.4 


AVERAGE DEIAY (IN DAYS) 


6.34 


6.63 


8.17 


8.54 


. TOTAL COST PER DAY 


1160 


1293 


1516 


1579 


COST PER SATISFIED REQUEST 


3.98 


1.73 


1.86 


1.90 



*250 days oE operation per year is assumed. 

TAT5LE XVIII: Network Perrormance With Policies That 
Emphasize Minimization of Average Delay 
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depends on a value judi^umunt cun^-urning a tradeoff betwcun probability of 
success and average delay. 

In general, policies that emphasize minimization of average delay are 
not acceptable for a small number of referrals (especially zero) because CPL 
is, closest (in terms of delivery time) to a great amount of request demand 
but is not as capable of satisfying that demand as ISL or UOI. However, with 
a larger number of referrals, policies that emphasize minimization of average 
delay might be appropriate if resources do not differ greatly in probability 
of success. Tor example, if Systeras have a reasonably high probahility of 
satisfying a request within, the System, they can avoid sending requests to the 
Center level of the network and lessen average delay over what would be 
obtained by using the Centers. In fact, it appears that Systems use a policy 
somewhat like this now. However, we want to emphasize that such a policy 
is not always preferrable as evidenced by the results in Table XVIII. 
D. POLICIES T]LAT.Tlli\Dl-OFF PRODABILITY OF 'SUCCESS AMD AVER/\GE DELAY • 

Now, We want to consider policies that emphasize both probability of 
success and average delay. Let us define the value of an alternative request 
routing policy, as ^ 



probability of: 



, J success . 

value of a policy = , , ■ . (3> 

* ^ average delay 

This definition of value is somewhat like a benef it-to-cost ratio, but is by 
no means anything other than an intuitively chosen definition. Various alter- 
native definitions of value could be employed and the difficulty is choosing 
the appropridte definition. Nevertheless, we will proceed to consider policies 
that emphasize maximization of value as defined in (3). 
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l*obi.iui> nic Juri.nid, viLhiii a ijubjecc class, by ordering Lhe four Cenlers 
,by .de^.ieasing value and then referring requesLs in diaL oriLer until a con- 
straint is met. Fur each SystQin and subject class, the value of each alter- 
native routo is calculated and the System initiates its requests at the Center 
whose associated route has the highest value to that System. Since this includes 
delivery tii.ie estimates, the Systems vill not all initiate their requests at 
the same Center. 

The results shown in Table XIX were obtained with this policy. These 
results are almost identical to those in Table XVII. The reason is simply 
that ISL and, to a lesser extent UOI, dominate the network in terms of our 
t!iree performance measures. I3L has the highest probability of success, the 
smallest avucage delay for satisfied requests, and tlie lowest processing 
costs since its filmed catalog allows the searching cost to be avoided. The 
only undesirable aspect of ISL is the large average delay for unsatisfied 
requests. We v;il ] return to? some of tliesp points, later in our discussion.. 

E. im rossiniLiTY of optimal policies 

In the previous sections, we considered three alternative approaches 
to policy formulation. A question that arises naturally from this discussion 
is: What is the best or optimal policy? Optimality can only be defined 
with respect to some criterion. In Project Report No. 1, wo defined an 
appropriate criterion for interlibrary loan networks to be maximization of 
service within any cost constraints. Then we proceeded to define service 
as having two cumponuntsj probability of success and average delay. ilo*y>over, 
this definition is insufficient since we must have some ^ay of deciding whe- 
ther or nut, for example, an increase in probability of success via referral 
is worth the^ increased average delay due to increased processing loads tliat 
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Pi-:RFORM/\NCE 
MKASURE 


NUMBER OF. RliFERll/XLS 


0 


1 


2 


3' ■ 


TNL'UT DEMAND VER DAY^- 


860 


860 


860 


860 


TOTAL im-\i\m Will DAY 


860 


1014 


1073 


1113 


■NO. SATISFIliD L'I:R DAY 


706 


801 - 


820 


829 


Nd'. UNSATISFIED PER DAY 


154. 


213 


253 


284 


PERCENT SATISFIED 


82.0 


93.2 


95.3 


96.4 


AVE1?AGE DKIAY (IN DAYS) 




7.57 


7.94 


8.23 


TOTAL COST PER MY 


1076 


1384 


1470 


1525 


COST I'KK SATISFIED lUiQUEST 


1.52 


1.73 


1.79 


1.84 



•••250 days o£ operncion per year is assumed. 

TABLIi: XIX: Nel:work Performance With Policies That 
Tradeoff Probability of Success and 
Average Delay ^ 
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Perhaps the policy valoe measure yiven in (3) is appropriate. Before 
such a ^choice is made, one should invest some* time into thinking about such 
performance measures. If a choice can appropriately be made, then the re- 
suiting optimization , problem (i.e.- Maximize the criteriuu vulMe ^= ...i 
subject to the constraints that...) may be amenable to one or more of the 
various optimization met|iodologies. We have looked briefly at two varia- 
tions of dynamic programming formulations and they appear to be applicable 
to several tenable policy performance measures. The development oX these 
approath^es might be an interesting effort to pursue in the future. 
F. DISCUSSION ^ * *. 

What conclusions can be tlxaxm from our analyses? Keeping in mind the 

paucity of the data, it is safe to say that the Centers of first resort 

should be ISL and UOI. The superiority of their performance over that of 

t 

CPL and SIU is clear. Wiy does this occur? One intuitively pleasing reason 
might be .nhe av.ni labil ity of ISL and UOI filmed catalogs. However, the resul 
in Table XIILdo not support this idea. ISL has a 0.80 overall probability 
of ownership for tho'-je requests received x^ithout call numbers. (We assume 
that these requests v;ure not aff^jctcd'by the availability of the film catalog 
UOI has a 0.72 probability of ownership (for requests without call numbers) 
Av'hile the probability of ownership) is 0.59 for CPL and 0.47 for SIU. The 
lower probabilities of ownership for CPL and SIU might be explained by the 
fact that many requests received by those Centers are referrals and thus, 
may be more difficult to satisfy. However, the results in Tables XI show 
that CPL and SIU have low probabilities of success for those requests x>;hich 
they receive directly from the Systems. Considering Table XIII, wo see that 
the difficulty at CPL is mainly availability with only 52% .of owned items 



* > 

'.being available. This is not surprising when we consider that CPL is the 
mily public library that serves as a Center in a network where most of the 
demand is from public libraries. Thus, the local clientele of CPL Is using 
the same typg of items that the Network clientele desires. On the other hand, 
sill seems^o "suffer from both a weaker collection (relative to the other 

• -A 

Centers) and somewhat of an availability problem. Perhaps its local clientele 
is less research oriented than that at UQI, ^ 

V/liat would, be the impact of removing CPL and/or SIU from the network? 
The results of such an analysis are shown in Tables XX through XXII. - Com- 
paring these results with those in Table XIX, we se.e that removal of CPL or 
SIU makes little difference. Removal of Both CPL and SIU only makes a diff- 
erence for requests that are referred more than once. Currently, this occurs 
^with approximately 137. of requests (Table XIB) and, even for those requests,, 
the degradation of service would be minor, .FrSm these analyses, we conclude 
that the -removol i^f both CPL and SIU should be seriously considered.. However, 
this concUision is based on liadted data and effort should be invested into 
gathering sufficient data to make this decision soundly. 

In general, all of the results pre::onted hare must be looked upon as 
tentative. The data simply does not allow specific recommendations that can 
be defended statistically. The next priority should be the development of 

data collection procedures' that will yield sufficient data to allow strong 

t 

reconmionda tions . 



?Thc approach to policy formulation discussed^in section IIT-I) was employed 
(i,e,, maximum value). 
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IM-Ul'OKMiXNCIi 
" MI-ASURK 


NUt-mFR OF "REFERRALS 


0 


1 ' 


2 


IN]>UT DEMAND PKR DAY-- 

r 


860 




860 


860 


TOTAL blJMiVNi) PKR DAY 


860 




1014 


1072 


NO.. SATISFIED m\ DAY 


706 




801 


- -819 


NO. UNSATLSFllilD PliR DAY 


154 




212 


253 


I'ERC'hYl' SATIS Fli-D 


82.1 




93.2 


95.2 


AVr:Ki\GE DlilAY (IN DAYS) 


5.92 




7.58 


7.97 


V TOTAL COS r PElt DAY 


1071 




1381 


1465. 


ICvOKT PKR SA-JTSFIIiD RlilQljliST 


1.52 




1.72 


1.79 



"250 <lay« pC opernuion per year is assumed. 



XABLK XX: Network Performance Without CPL 
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1)1? Pirn DMA Mr*i? 


NUM15ER OF WiEERRALS \ 


' . ' MI-AHIIRB 


0 


1 


, 2 


INPUT DKMN'D per DiVi'-- ' 


860 


/ 860 


860 


wmi Dumm) mi day 


860 


lOlA 


1073 


NO . SATIS nz6 . VEK DAY 


706 


801 

r 


817 


NO'. UNSATISFI-i-lD PKll DAY 


154 


213 ' 


•256. 


PliRCKNT SATISl-IliD 


82.0 


93.2 . 


•V 94..9„ 


AVEIUGK DBIAY (IN DAYS) ' 


5.92 


7'.57 


7.88 


TOTAL COST PER DAY 


1076 


. 1385 


1A66 


COST PRR SATISFIED REQUEST 


1.52 


1.73 


■ 1.80 



•>''250 tl.'iys ol^ opcnitLon poc yuiir is ns.sumo.d. 



TAIJLE.XXI: Network Perlorniancc Without SIU 
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PKRFOimNCE 


NUMBER OF REFERRALS 


^u•:ASUlUi: 


0 


1 


INPUT Dn:M/\Nrl per day-'- 


■^60 


.4 860 


TOTAL mmm) PER DAY 


- 860 ; 


lOlA- 


NO. SATl^IliD PER DAY 


706 


801 


NO. UNSATISFIIil) PI- R DAY 


. 15A 


212 


PKRCKNT SATISFIED 


82.1 


93.2 . 


AVEl?i\GE DEIAY (IN DAYS) - 


5.92 


7.58 


. TOTAL COST. PER DAY 


ion 


1381 


XOST PER SATISFIED REQUEST 


1.52 


1.72 



'^ZSO'days of operation per year 1j5 as^sumcd 

TABLE XXri: Netv;or4c Performance Without CPL and SIU 
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APPENDIX 

ASSUMFrXOM& IN PROCESSING TllB LRC SAMPLES 

A^ INTROUUC'IMON , . 

■\' . •. • . 

' Various. t\ssun»peions and, manipuia Lions of Lhc raw data vavc 

necessary in <jx-dcr^ obLain Llie necessary daia Cor <tlic model. In this 

Appendix, we ^^fill detail these assumptions and note hov» they differ for the 

''two LRC samples. in earlier sections of this report, we denote the LRC . 

sample:; as network sample and cc»:ter' sa\uple. 

B. VERIFICATION AND CALL NUMBER DATA 

Verification data was used to determine whether or not time was 
spent by the Center in verifying the request and whether or not they were 
successful m verification. The model for in tra-library processing assumes 
that if a Center siicccssfully verified a rv^quest, ihpy would i:o-scarch the 
request in their catalog. If the "Center was unsuccessful in verifying tne 
request, they \vbuid necessarily/f onv^ard the request to another Center or back 
to the requcstd.iV System. , . 

Two types of data from LRC's samples arc used to de termine • whether^ 
or not time was spent in the verifiiaLion process, if verification was 
success Cul, and if a calL/number was previously provided./ 

•Co dclermino wliutlicr or not time was spent in the verification proces 
we used the cLnta' coded for "verification accuracy." If a Center indicated 
"1-verif. and acc.,*' wc .asi>umed the request x^fas previously verified, and the 
Center rccoivinij tlic request did not spend time ^vo^riCying. In general, any 
<:r^^er code indicating "verification accuracy" (e.g., "2-vcVif. and inacc," 
"3-Mnverif.j verif. at R& U," or "A-unverif., not able") meant that the Center 
receiv,ing the request spent time In the verification process. 
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A brief note appears necessary regarding our interpretation of the 
code "4-unverif., not able/* which was only used in the network sample • We 
assumed this code was indicated by a CcitLer which spent time ^rifying a 
request but was unsuccessful. Because "unverif,, noE^^^^^le" is ambiguous 
with respect to time bpent verifying, we disciissed our assumption with the 
Director of the U. of I. Illinois Interlibraizy Borrowing Office. She confirmed 
our assumption that most Centers try to verify but felt that if we found many 
requests with this verification status, our assumption is pt^^ ^''^ly laun; 
Indicating the Center did not try to verify. Since wo found only four requests 
w^^tli this verification status, we feel our interpretation of this data is 
reasonable • 

lo determine whether or not a Center \^as successful in verifying a 
request we used tiie data coded for "verification tool." We assumed that any 
code entered meant the Center was successful in veri Tying the request . 

Distribution for verification accuracy and verj.f ication tool codes 
are given in "Tal Le Al. From Table Al, the data indicates that for CPL 
(combined sample) 266 requests were coded "l-verif. and acc." We interpret 
this data to mean that GPL did not try to verify 266 requests. llo\>?ever, we 
find that CPL coded a veriCicatioh tool for 267 requests (584 - 17 = 267) 
which according to our assumption indicates 267 requests were successfully 
verified. . In other words, 266 requests were previously verified ai^d 

successCuli^'*i:e-vt. I'iricd at/CPL. This general Lrcnd can ho Illustrated ^ 

*. 

in Table Al for tUe other Centers. 
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CPL 



ISL 



No. 



No. 



Ver. Acc. No. Fill No Fill* Total 



1 
2 
3 
4 

No Code 
Total 

Vcr. Tool 



70 
I 
4 
0 
D 

75 



196 
1 
8 
4 
0 

209 



266 
1 
12 
4 
0 

284 



1 


"12 


138 ' 


150 


2 


0 


0 


0 


3 


36 


3 


39 


4- 


0 . 


7 


7 


5 


5 


17 


22 
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0 


i 


1 


7, 


1 


9 


10 


8 


0 


1 


1 


9 


17 


20 


37 
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4 


13 


17 


Tot-l 


75 


209 


284 



No. witliout fill code = 0 



Ver. Acc. No. Fill No Fill Total 

1 
2 
3 
4 

No Code 
-Total 

Ver. Tool 

1 

2 
3 
4 
5 
6 
7 
8 

9 ' 
No Code 
Total 

No. without fill code = 3 
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99 
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2 


0 


2 


5 


9 


14 


2 


2 


4 


8 


1 


9 
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27 


57 


U 


0 
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0 


A 
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0 
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o 
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3 
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6 


2 


8 
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55 
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0 


0 


0 


47 


9 


56 


43 


■ 14 


57 
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UOI 
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No. 








•No. 




Ver. Acc. No. Fill No Fill 
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Ver . Acc . No . Fill 
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1 
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• 1 


71 
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267 


2 • 


:» 


4 


9 




0 


.0 . 


0 


3 


27 


11 


38 


3 


5 


9 


14 


4 


9 
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17 


h 


0 


3 


3 
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3 


0 


3 


No Code 


1 


iO 


I 
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336 


214 


550 


Total 


77 
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Ver. Tool 








Vcr . Tool 








1 
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98 ■ 


167 


1 


26 
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150 


2 


0 


1 


1 


2 


0 


0 


0 


3 


3 


0 


3 


3 


0 


0 


0 


4 


9 


8 


17 


4 


1 


5. 


6 


5 


41 


21 


^ 62 


,5 


10 


22 


32 


6 


6 


• 4 


10 


6 


4 


3 


7 


7 


6 


7 


13 




3 


13 


16 


8 


52 




62 




1 


3 


" 4 


9 




45 
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9 


■26 


26 


52 


No Godo 


37 


20 


■ 57 


No Code 


6 


12 


18 


Total 


336 


, 214 


550 


Total 


77 


208 


285 


No. witliout 


cm code 


= 5 




No. without 


fill code = 3 ^ 










No. without 


Cuutor 


code - 0 


\ 



Table A-1. Verification Information 
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Af'-.cr looking aL some yearly sLatistics £com ISL wc realized that 
our assumpLions needed revising. In particular, iSL and UOI claimed to receive 
71% and 117, o£ their requests with previously provided call numbers. We 
decided to assume that i.£ a Center indicated "1-verif. and acc." for "verifica- 
tion accuracy" we ignored any data coded for "veri£ica.tion tool," and assumed 
•the Center did |iot spend time verifying the request. 

The one exception to i his assumption arises in the deteniiination of 
whether or not a call number was previously provided. In this case, we used 
the data coded for "verification tool." The model for intra-library process- 
ing assumes that if a call number is previously provided, the Center receiving 
the request dues not spend time in the search process, i.e., a main catalog 
search, not a shclf-list search. 

Because ISL and UOI are the only Centers with holdings tools 
indicated by the "verification tool" data wcycan expect that only these 
Centers will possibly bypass the search process. CPL and SIU will enter the 
search process for every request they receive beca'use the data does not 
indicate whether or not a call number, was previously provided for those 
Centers. 

In tlic case fnr requests received by ISL and UOI, we assumed the 
request was provided witli a call number if ISL qr UOI indicated the "verifi- 
cation tool" for their respective holdings, i.e., a code of "7" or "8" 
respectively. I'rucessing the data for Table 'XIII (nee text) we see that 
Uiic CollowLng probabilities indicate the percent of requests entering the. 
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Center with previously provided call numbers: CPL - 0.00 (0.01), 
ISL - 0.70 (0.71), UOI - 0.11 (0.11), and SIU - 0.00 (0.03). The probabilities 
in parentheses are from ISL's yearly statistics which ara closely predicted 
by the sample data usinjj the appropriate assumptions. 

All of the assumptions outlined in this section apply to both 
netv/ork and center samples. 

C. OBTAIN AND OUT-rilOCESS DOCUMENT 

If a request was indicated "filled" by thb Center, we assume the 
Center obtained the document and out-processed the document for delivery. 
This data wat> interpreted the same way for both network and center samples. 

D. OUT-PROCESS, NO PILL 

For requests not filled, we assume the Center owned the document 
but that it was not available if the Center indicated "2 = in circ," 
"3 = mm circ.,'' ' - on order/in process," "5 = would send, not available," 
or "7 - N\>/A too near." We assumed a rac[uest v;as not owned by a Center if 
they indiccitcd "1 ^ not owned," "6 = citation unusable," or "8 = inappropriate/ 
Interpretations f-ibvut whether an item was ouwcd or not owned were made 
independent of veriCLcatitm data and based solely on "fill/no fill" status 
and "reason Cor no fill" data. Interpretation of thb data is the same Cor 
both network and center samples. 

E. iniOCESSlNG TLMI; AND lUil-EIU^\L OIU)ER 

l-or the network sample v;c converted dates to Julian days and Jjave 
included wcukuiid^i and hoUJ«^y«. Therefore processing times may appear longer 
than actual time in process at the library or subnodes. 



Referral order is implied by the dates and if referral order data 
does not corruspond with Julian date order, ue assume the referral order 
was incorrectly entered <ind use the Julian day for ordering referrals. 

If a referred request has no date-out indicated, we assume the 

date-out from the Center is equal to the date-in of the next Referral 

Center, Similarly, if no date-in is indicated for a zeroeth Referral Center, 

* 

v/e assume the date-in of thu /.croeth KeCcrr<il equai to tiie d.ite-out of the 
allocating System. 

If no date-out is indicated for the last Referral Center, we 
then have no data on overall processing time for that request. We could 
perhaps cal.cuiate an average processing time for that Center (based on 
the complete data) and find an estimated Julian day for date-out. 

Since Julian days were entered in the Center sample and request 
history daia -as not available, v;e did hot have to manipulate the referral 
order oi datt ' * If no referral number was inuicated for a icqucst in 
this sample, \?e assumed the request was a direct request. 
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